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METHOD, SYSTEM, AND PROGRAM FOR HALFTONING DATA FOR 
RENDERING IN A MULTITONE OUTPUT DEVICE 

Cross-Reference to Related Applications 
5 This application is related to the following co-pending and commonly- 

assigned patent application entitled "Dithering Method and Apparatus for Multitone 

Printers," to Charles H. Morris, III, Joan L. Mitchell, Chai Wah Wu, Gehard R. 

-7/ ? 

Thompson, Charles P. Tresser, and Nenad Rijavec, having U.S. Patent Applic atio n 
Seri al Nu. 09/412, 6 45 , and filed on October 4, 1999. This patent application is 
1 0 incorporated herein by reference in its entirety 



BACKGROUND OF THE INVENTION 
1. Field of the Invention 

The present invention relates to a method, system and program for halftoning 
1 5 input data to produce output values capable of being rendered by a multitone output 
device, such as a multitone printer. 



2. Description of the Related Art 

Digital images comprise pels or points of data that have one of many values 

20 representing a color or shade of gray value for that pel For instance, many digital 
images may be expressed using 256 different intensities of gray, including black and 
white. However, laser printers are typically only capable of printing in black or white, 
or two different color values. To create the appearance of different shades of gray, 
prior art bi-level (i.e., black and white) laser printers utilize dithering algorithms. A 

25 dithering algorithm creates the illusion of new colors and shades by varying the 
pattern of dots. In this way, different shades or intensities of gray are produced by 
varying the patterns of black and white dots. In such bi-level printers there are no 
gray dots. However, there are output devices that include the fiiU range of 
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intermediate values and do not need halftoning, such as computer display monitors 
that display 16 million colors. 

One common form of a dithering algorithm involves the use of a threshold 
matrix of values with which the values of picture elements or pels in the image are 
5 compared. The same matrix pattern is employed repeatedly to cover the image. The 
binary output value, i.e., black or white, for the bi-level printer is based on a 
comparison of whether the pel gray scale value is greater or less than the threshold 
value. The commonly assigned patent entitled "Clustered Aperiodic Mask", having 
U.S. Patent No. 5,917,951 provides techniques for creating the threshold matrix. 

10 The above techniques are intended for dithering gray scale data for a bi-level 

printer. However, multitone printers can print at least some intermediate levels 
between white, i.e., nothing printed, and the full saturation value, i.e., black. There is 
thus a need in the art for providing halftoning algorithms for use with multitone 
printers to provide improved results when images are halftoned and printed on 

1 5 multitone printers. 

SUMMARY OF THE PREFERRED EMBODIMENTS 
To overcome the limitations in the prior art described above, preferred 
embodiments disclose a method, system, and program for halftoning data for an 
20 output device capable of rendering multiple intensities. Input values are received. 
For each received input value, the input value is used as an output value if the input 
value is a predetermined value. Otherwise, if the input value is not the predetermined 
value, then the input value is halftoned to produce an output value used to render one 
of multiple intensities. 

25 In certain embodiments, the input pel value is in a first intensity range and the 

output value is in a second intensity range of values that are capable of being rendered 
by the multitone printer. The intensity ranges may comprise intensities of grays or 
colors. 
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In further embodiments, halftoning the input value further comprises 
determining a value from a first matrix of values. The input value and the determined 
value are used to produce an intermediary output value in the first intensity range. A 
second matrix is used to determine one output value in the second intensity range 
5 based on the intermediary output value in the first intensity range. The second matrix 
provides one output value in the second intensity range for any given intermediate 
output value in the first intensity range. 

In still further embodiments, a determination is made as to whether the input 
value is greater than the determined value from the first matrix. If the input value is 

1 0 greater than the determined value^then the second matrix is used to determine one 
output value in the second intensity range. Otherwise, if the input value is less than 
the determined value from the first matrix, then a predetermined output value in the 
second intensity range is used. 

Preferred embodiments provide a technique for halftoning input data to 

1 5 produce output intensity values capable of being rendered by a multitone printer. 

With preferred embodiments, if the input data comprise binary values, i.e., black (full 
saturation) or white (zero intensity), then predetermined outputs, such as the actual 
binary values, are used as the output. Only if the input data is not binary values is a 
halftoning algorithm then applied to convert the input data to an output value. This 

20 preferred embodiment technique is intended to address the situation where the input 
data to the multitone printer may have already been halftoned. It has been observed 
that halftoning data already halftoned produces undesirable printing results. 

The preferred embodiments address this problem by not subjecting pels in 
binary form that could have been subject to halftoning to yet further halftoning or 

25 dithering. Only if the pels are intermediate values between white (no printing) and 
black (full saturation) is the halftoning algorithnl applied to produce output intensity 
values. 



.4- Express Mail No. EL637621928US 

Docket No. BLD920000057US1 
Firm No. 0036.0084 

BRIEF DESCRIPTION OF THE DRAWINGS 

Referring now to the drawings in which like reference numbers represent 
corresponding parts throughout: 

FIG. 1 illustrates a printing computing environment in which preferred 
embodiments are implemented; 

FIG. 2 illustrates examples of matrix data structures in accordance with 
preferred embodiments of the present invention; and 

FIG. 3 illustrates logic to screen data for a multitone printer in accordance 
with preferred embodiments of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
In the following description, reference is made to the accompanying drawings 
which form a part hereof and which illustrate several embodiments of the present 
invention. It is understood that other embodiments may be utilized and structural and 
operational changes may be made without departing from the scope of the present 
invention. 

The co-pending and commonly assigned U.S. patent application entitled 
"Dithering Method and Apparatus for Multitone Printers," having U.S. Patent 
Ap plication Senal - ^r09 / 4i = g;6 4 5 , incorporated by reference above, describes a 
technique for halftoning data for use with a multitone printer. This application 
describes a process involving the use of a threshold matrix M and decision matrix D. 

The threshold matrix M provides threshold values T^j depending on the 
location of the input data P, The input data P may comprise a pel. The term "pel" as 
used herein refers to an intensity input at a data point that represents data to be 
rendered (i.e., printed, displayed, etc.), where the data to be rendered may include, but 
is not limited to, images, text, composite, graphs, collages, scientific data, video, etc. 

The decision matrix D provides values that the multitone printer can print. 
The patent appfagggmi aciial iiu. 09/112,615 describes an algorithm where an input 
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value is compared against the corresponding threshold value T^ j in the threshold 
matrix. The decision matrix D is used to determine the output intensity value capable 
of being rendered by the multitone printer. In one embodiment, the output value in 
the decision matrix is a function of T-P, 
5 Undesirable output results have been observed if the algorithms usine the 

threshold matrix M and decision matrix D described in patent apphcation - scrial no . 
0 9/412,645 are applied to binary data that has already been processed with a 
halftoning algorithm. 

Preferred embodiments provide a technique to account for the possibility that 

10 the input data to the multitone printer has already been halftoned by a dithering 
algorithm in order to avoid undesirable results from re-halftoning binary data. 

FIG. 1 illustrates a printing computing environment in which preferred 
embodiments are implemented. A multitone printer 2 includes control logic 4 to 
perform the preferred embodiment halftoning operations. The control logic 4 may 

1 5 comprise a programmable chip, such as a field programable gate array (FPGA) chip, 
which includes logic. A memory device 6 includes input data 8, a threshold matrix 
(M) 10, and a decision matrix (D) 12. The memory device 6 may comprise any high 
speed memory device known in the art, such as a static random access memory 
(SRAM), random access memory (RAM), etc. The input data 8 comprises scan lines 

20 of pels that can be either in binary form, i.e., a high (black) or low (white) values, or 
gray scale values, e.g., 0 through 255. Further, some of the input data 8 could have 
previously been subject to halftoning and dithering algorithms. 

In preferred embodiments, the control logic 4 accesses input data 8 from 
memory 6 and applies the threshold matrix 10 and decision matrix 12 to produce an 

25 output intensity representing either no printing, one of the multiple intermediate 
intensities, or a fiill saturation value (black) that the print apparatus 20 is capable of 
printing. For instance, if the print apparatus 20 can print fourteen intermediate values 
as well as full saturation, then the output value would comprise four bits to represent 
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one of sixteen outputs. The print apparatus 20 may comprise any printing mechanism 
known in the art, including a laser beam, charged-coupled device (CCD), ink jets, 
material deposition, etc. 

The decision matrix D 12 may include a ramp-up of the output intensity gray 
scale values supported by the multi-tone printer. Such a ramp-up in the values of the 
decision matrix D would involve repeating the output intensity values for consecutive 
index values, where the index values are the possible intermediate gray scale values. 
Further, with certain multitone printers that support up to sixteen different printing 
levels, certain of the lower gray scale values, e.g., the first three or four such output 
intensities, may produce unreliable results. In such case, the first output intensity in 
the matrix D would begin at the first reliable output intensity value, e.g., 3 or 4. An 
example of a decision matrix 100 is shown in FIG, 2. The decision matrix 100 
includes an entry or value for each of the index values, such as 256 entries. In the 
matrix 100, the first reliable halftone produced by the multitone printer 2 is for the 
halftone value of 5. The decision matrix 100 ramps up fairly quickly and repeats the 
highest halftone value, which for this implementation is "15", for the most of the 
output values. In alternative embodiments, different arrangements of the output 
intensity values may be used to populate the decision matrix Z). 

In preferred embodiments, the threshold matrix Mand decision matrix D 
comprise a point algorithm as the intensities rendered at each pel do not depend on 
the value of neighboring pels. This is in contrast to neighborhood algorithms, such as 
error diffiision, which require the neighboring input pels to determine the image to be 
printed. In general, point algorithms are faster and require less data storage then 
neighborhood algorithms. 

Preferred embodiments are described in terms of gray scale images where each 
pel has a single value. For color images, each pel may be composed of three or more, 
typically four, color components, e.g., cyan (C), magenta (M), yellow (Y), and 
sometimes black (K). Each component of these CMY and CMYK images may be 
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treated as a "gray scale" image of that component. Those skilled in the art will 
recognize how to extend the preferred embodiments from the gray scale images into 
multiple component color images. When printing a binary representation of each 
component of a color image, the threshold matrices are tuned for each color 
5 component. Thus, the dimensions of the threshold matrices and the values T 

contained therein may differ for each color component. In addition, with gray scale 
images, the value of 0 is used to represent white and the value of 255 represents full 
black (or full tone if color halftoning), however alternative conventions may be used 
such as the opposite values, which would use 255 for white and 0 for black. 

10 The threshold matrix M includes threshold values T. - and has mxn entries. 

The decision matrix D includes output intensity values dp j that are a function of the 
input value P and the corresponding threshold value in the threshold matrix T^j, The 
input P^ ^ at location (w, v) will get printed as a dot of gray level dp p where T is the 
corresponding threshold value 7]^, where / = u mod m and j = v mod n. This 

1 5 operation is performed by a lookup function. The output dp j is sent to the print 
apparatus 20. 

In preferred embodiments, the decision matrix D is used as a lookup table. If 
the decision matrix D is endowed with some special structure or is defined by some 
simple algorithmic procedure, then instead of looking-up dp ^ in the matrix D, dpj 
20 can be calculated directly by an algorithm, whose output dp j is sent to the print 
apparatus 20. 

FIG. 2 further provides an example of a threshold matrix 102. The values in 
the threshold matrix M may be generated using dithering algorithms known in the art. 
In populating the threshold matrix M, the goal is to produce a visually pleasing effect 
25 and smooth and monotonic gray scale transitions in the image. Techniques known in 
the art for designing threshold matrices for dithering for a bi-level printer (i.e., one 
that prints only black or white) may be used to design the threshold.matrix used with 
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the preferred embodiments. Further, the values selected for the threshold and 
decision matrices may be based on the printing capabilities of the multitone printer 

Still further, the threshold matrix M 102 in FIG. 2 alternates between small 
and large intensities, such that the values in a colunm are either all less than 128 or 
greater than 128. This pattern of output values in the threshold matrix Af 102 in FIG. 
2 forms vertical stripes of alternating intensity for uniform input values of 128. This 
arrangement is desirable because alternating the intensity of output values has been 
found to produce improved output results. 

In preferred embodiments, the threshold matrix Mis used to provide 
halftoning when the output device renders less than a full range of intensities. 
However, certain output devices that provide a full range of intensities may not 
require halftoning. For instance, a display screen renders 16 million colors, and thus 
dithering and halftoning may not be needed to provide the illusion of various 
intensities because such various intensities are capable of being rendered. 
Nonetheless, even output devices rendering a complete range of intensities, such as a 
display screen capable of rendering 16 million colors, may still utilize halftoning to 
provide improved rendering results. 

FIG. 3 illustrates logic implemented in the control logic 4 to generate output 
values comprising output intensity values, e.g., one of the sixteen outputs the print 
apparatus 20 can render. The input data 8 to the control logic 4 may comprise gray 
scale values, e.g., 0 through 255, or already screened binary data that has one of two 
values, e.g., 0 or 255. Control begins at block 200 with the control logic 4 accessing 
an input pel ^ from the input data 8. The control logic 4 determines (at block 202) 
a threshold value T^ j in the threshold matrix M based on the position of the input pel 
P^ ^ with respect to the threshold matrix M. For instance, if the threshold matrix M is 
an 8x8 matrix as shown in FIG. 2, then the threshold matrix M would provide 
threshold values for 8x8 windows of input data. If (at block 204) the input data P^ ^ 
is equal to zero, then the control logic 4 generates (at block 206) an output of zero. If 
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(at block 208) the input pel is equal to 255, i.e., the highest gray scale value, then 
the output pel (at block 210) is OxF, or the highest output intensity gray scale value 
(e.g., 15 or full saturation). 

Blocks 204 and 208 are intended to handle the situation where the input pel 
value is a binary value that may have already been halftoned by a dithering algorithm 
or data originally intended for a bi-level printer. In such case, the logic of FIG. 3 
provides predetermined output intensity values corresponding to the input binary 
values. In this way, further halftoning and dithering of binary input data at the highest 
and lowest possible gray scale values is avoided. 

If (at block 212) the input pel P^ ^ is greater than or equal to the determined 
threshold value T^ j, then the control logic 4 determines (at block 214) ttie {P^ ^ - 7),y)th 
entry in the decision matrix D^_j^ to determine the corresponding output intensity 
value dp j for the difference. This determined output intensity value dp j in the 
decision matrix D is then the output to the print apparatus 20. Otherwise, if the input 
value P^ ^ is less than the determined corresponding threshold value T^ j, then the 
output is zero (at block 216). The steps at block 212 and 214 provide the halftoning 
of the input gray scale data that has not already been subjected to halftoning. 

Thus, with the logic of FIG. 3, the input values are only halftoned if they are 
gray scale values, i.e., not possible binary values 0 or 255. If the input values are 
possible binary values, then the preferred logic does not re-halftone the data. This 
algorithm eliminates the possibility that already halftoned binary data will be 
halftoned again to avoid the undesirable results that have been observed with twice 
halftoned data. With the preferred logic, the dithering results of previously halftoned 
data will remain and be outputted to the print apparatus 20 as only intermediate gray 
scale data not previously halftoned will be subject to the transformation and dithering 
of the threshold matrix M. Thus, the logic of FIG. 3 is designed to optimally handle 
both halftoned binary data as well as gray scale intermediary input values. Note that 
blocks 204 and 208 could have preceded block 202. 
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Alternative Embodiments and Conclusions 
This concludes the description of the preferred embodiments of the invention. 
The following describes some alternative embodiments for accomplishing the present 
invention. 

5 The preferred embodiments may be implemented as a method, apparatus or 

program using standard programming and/or engineering techniques to produce 
software, firmware, hardware, or any combination thereof The program, code and 
instructions in which the preferred embodiments are implemented are accessible from 
and embedded in an information bearing medium, which may comprise one or more 

10 computer-readable devices, firmware, programmable logic, memory devices (e.g., 
EEPROMs, ROMs, PROMs, RAMs, SRAMs, etc.), hardware, electronic devices, a 
computer readable non-volatile storage unit (e.g., CD-ROM, floppy disk, hard disk 
drive, etc.), a file server providing access to the programs via a network transmission 
line, wireless transmission media, signals propagating through space, radio waves, 

15 infi-ared signals, etc. Of course, those skilled in the art will recognize that many 

modifications may be made to this configuration without departing fi"om the scope of 
the present invention. 

Preferred embodiments were described with respect to a printer output device. 
However, the output values may be rendered using output devices other than printers, 

20 such as such as display monitors, a storage device for fixture rendering, a transmission 
device, etc. 

In preferred embodiment, the control logic is implemented as hardware, e.g., a 
Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit 
(ASIC), etc. In alternative embodiments, the control logic may be implemented as 
25 programmable code in a programmable processor. 

In preferred embodiments the range of intensity inputs is greater than the 
range of output intensities capable of being rendered on the output device or printer. 
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In alternative embodiments, the range of intensity inputs may be less than the range of 
intensity outputs. 

In preferred embodiments, there was one decision and one threshold matrix. 
In further embodiments, multiple decision and threshold matrices may be used. 

Preferred embodiments described a screening process that used both a 
threshold matrix and decision matrix. However, those skilled in the art will 
appreciate that numerous screening algorithms may be applied to transform the gray 
scale data to output intensity values that can be rendered by the multitone printer. 

In preferred embodiments, certain output values were determined from a table 
and others, 0 and 255, were bypassed using the algorithm of FIG. 3. In alternative 
embodiments, a look-up table may provide values for each possible input value, 
including 0 and 255, the extreme values. 

The memory 6 may be implemented in one memory chip or dispersed 
throughout multiple memory chips. In altemative embodiments, the matrices 10 and 
1 2 may be maintained in a magnetic memory, as opposed to an electronic memory 6. 
Still further, the matrices 10 and 12 may be encoded in hardware logic, such as 
ASICs, FPGAs, Electronically Erasable Programmable Read-Only-Memory 
(EEPROM), etc. 

In summary, preferred embodiments disclose a method, system, and program 
for halftoning data for an output device capable of rendering multiple intensities. 
Input values are received. For each received input value, the input value is used as an 
output value if the input value is a predetermined value. Otherwise, if the input value 
is not the predetermined value, then the input value is halfloned to produce an output 
value used to render one of multiple intensities. The foregoing description of the 
preferred embodiments of the invention has been presented for the purposes of 
illustration and description. It is not intended to be exhaustive or to limit the 
invention to the precise fomi disclosed. Many modifications and variations are 
possible in light of the above teaching. It is intended that the scope of the invention 
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be limited not by this detailed description, but rather by the claims appended hereto. 
The above specification, examples and data provide a complete description of the 
manufacture and use of the composition of the invention. Since many embodiments 
of the invention can be made without departing from the spirit and scope of the 
5 invention, the invention resides in the claims hereinafter appended. 



